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IN THE CLAIMS : 

1 . (Currently Amended) A method for controlling a computer using at least one 
video image of a plurality of video images, the method comprising: 

(a) capturing n video streams, n being an integer of at least two, the n 
video streams each comprising a plurality of video frames and each of 
the n video streams comprising video of a different user; 

(b) determining a location of an object in at least one of the n video 
streams; 

(c) controlling a program executing on the computer based on the location 
of the object; 

(d) combining, at a single computer, the n video streams with a user 
interface stream generated by a computer operating system, thereby 
forming a composite video stream; 

(e) providing the composite video stream for display to each of the different 
users; and 

(f) displaying the composite video stream , wherein displaying the 
composite video stream includes displaying images of the different 
users on or behind a desktop interface and allowing the images of the 
different users to interact with desktop contents . 

2. (Previously Presented) The method of claim 1 wherein capturing n video 
streams includes receiving a live video signal of a user generated by a video 
camera. 
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3. (Previously Presented) The method of claim 1 wherein capturing n video 
streams includes receiving a stored video signal from a video storage device. 

4. (Previously Presented) The method of claim 1 wherein determining the 
location an object in at least one of the n video streams includes: 

(a) searching for a predetermined color in one of the n video streams; 

(b) in response to locating the predetermined color, identifying an 
occurrence of the predetermined color having the largest area; and 

(c) determining coordinates of the center of the occurrence of the 
predetermined color having the largest area. 

5. (Previously Presented) The method of claim 1 wherein controlling a program 
executing on the computer based on the location of the object comprises: 

(a) analyzing motion of the object in successive video frames to determine 
presence of a control event; and 

(b) controlling the program based on the control event. 

6. (Previously Presented) The method of claim 5 wherein each of the n video 
streams comprises an image of a different computer user, the object 
comprises an object associated with the user's hand, and the control event 
comprises a pointer movement event. 

7. (Previously Presented) The method of claim 5 wherein each of the n video 
streams comprises an image of a different computer user, the object 
comprises an object located in the user's hand, and the control event 
comprises a mouse click event. 
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8. (Previously Presented) The method of claim 1 wherein combining the n video 
streams with the user interface stream generated by the computer operating 
system includes horizontally reversing frames of the n video streams to 
produce a mirror image of the frames of the n video streams. 

9. (Previously Presented) The method of claim 1 wherein combining the n video 
streams with the user interface stream generated by the computer operating 
system includes transparently overlaying the user interface stream on the n 
video streams. 

10. (Previously Presented) The method of claim 1 wherein combining the n video 
streams with the user interface stream generated by the computer operating 
system includes transparently overlaying the n video streams on the user 
interface stream. 

1 1 . (Previously Presented) The method of claim 1 wherein combining the n video 
streams with the user interface stream generated by the computer operating 
system includes: 

(a) adjusting a transparency level of at least one of the user interface 
stream and the n video streams; and 

(b) generating the composite stream from the user interface stream and the 
n video streams. 

12. (Original) The method of claim 11 wherein adjusting the transparency level 
includes dynamically adjusting the transparency level. 

13. (Original) The method of claim 1 wherein displaying the composite video 
stream includes projecting the composite video stream. 
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14. (Canceled) 

15. (Canceled) 

1 6. (Currently Amended) A method for combining a plurality of video images, each 
containing an image of a user, with a computer desktop interface, the method 
comprising: 

(a) capturing n video streams, n being an integer of at least two, each 
video stream comprising a plurality of frames and each video stream 
comprising video of a different user; 

(b) transparently combining, at a single computer, the n video streams with 
a computer desktop generated by a computer operating system, 
thereby forming a composite video stream; 

(c) providing the composite video stream for display to each of the different 
users; and 

(d) displaying the composite video stream, wherein the composite image 
includes transparent images of the users displayed with the computer 
desktop , wherein displaying the composite video stream includes 
displaying images of the different users on or behind the computer 
desktop and allowing the images of the different users to interact with 
desktop contents . 

17. (Previously Presented) The method of claim 16 wherein capturing the n video 
streams includes receiving a live video signal generated by a video camera. 

1 8. (Previously Presented) The method of claim 1 6 wherein combining the n video 
streams with the user interface stream generated by the computer operating 
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system includes horizontally reversing frames of the n video streams to 
produce a mirror image of the frames of the n video streams. 

1 9. (Previously Presented) The method of claim 1 6 wherein combining the n video 
streams with the user interface stream generated by the computer operating 
system includes: 

(a) adjusting a transparency level of at least one of the user interface 
stream and the n video streams; and 

(b) generating the composite stream from the user interface stream and the 
n video streams. 

20. (Original) The method of claim 19 wherein adjusting the transparency level 
includes dynamically adjusting the transparency level. 

21. (Original) The method of claim 16 wherein displaying the composite video 
stream includes projecting the composite video stream. 

22. (Original) The method of claim 16 wherein displaying the composite video 
stream includes displaying the composite video stream on a non-projection 
computer display device. 

23. (Previously Presented) The method of claim 16 wherein displaying the 
composite video stream includes displaying a mirror image of each user with 
the desktop. 

24. (Previously Presented) The method of claim 16 comprising controlling objects 
on the desktop in response to movement of at least one of the user images. 

25. (Previously Presented) The method of claim 24 wherein controlling objects on 
the desktop includes moving objects on the desktop. 
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26. (Previously Presented) The method of claim 24 wherein controlling objects on 
the desktop includes activating programs associated with objects on the 
desktop. 

27. (Previously Presented) The method of claim 16 wherein the desktop 
comprises the desktop of a computer local to at least one of the users. 

28. (Previously Presented) The method of claim 16 wherein the desktop 
comprises the desktop of a computer remote from at least one of the users. 

29. (Previously Presented) The method of claim 1 6 wherein each of the plurality of 
video streams includes an image of a different user. 

30. (Previously Presented) The method of claim 29 comprising controlling desktop 
objects in response to movement of user images in any of the video streams. 

31. (Currently Amended) A computer-readable medium having stored thereon a 
set of computer-executable instructions, the set of instructions comprising: 

(a) n video stream capturing routines, n being an integer of at least two, 
each of the video stream capturing routines for capturing a different 
video stream, each video stream comprising a plurality of video frames 
and each video stream comprising an image of a different user; 

(b) a video frame analysis routine for determining a location of an object in 
at least some of the plurality of video frames; 

(c) a driver for controlling a program executing on the computer based on 
the location of the object; 

(d) a video compositing routine for combining, at a single computer, the n 
video streams with a user interface stream generated by a computer 



-7- 



Serial No. 10/562,240 



operating system, thereby forming a composite video stream and for 
providing the composite video stream for display to each of the n users; 
and 

(e) a video display routine for displaying the composite video stream^ 
wherein displaying the composite video stream includes displaying 
images of the different users on or behind a desktop interface and 
allowing the images of the different users to interact with desktop 
contents . 

32. (Previously Presented) The computer-readable medium of claim 31 wherein 
the user interface driving routine comprises: 

(a) instructions for searching for a predetermined color in at least one of 
the n video streams; 

(b) instructions for identifying an occurrence of the predetermined color 
having a largest area; and 

(c) instructions for determining the coordinates of the center of the 
occurrence of the predetermined color having the largest area. 

33. (Previously Presented) The computer-readable medium of claim 31 wherein 
the video compositing routine comprises: 

(a) instructions for adjusting the transparency level of at least one of the 
user interface stream and the n video streams; and 

(b) instructions for generating the composite stream from the user interface 
stream and the n video streams. 
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34. (Previously Presented) The computer-readable medium of claim 31 wherein 
the video compositing routine comprises instructions for horizontally reversing 
images of the n video streams to produce a mirror image of the images of the 
n video streams. 

35. (Currently Amended) A computer readable medium having stored thereon 
computer-executable instructions for performing steps comprising: 

(a) receiving n video images, n being an integer of at least two, each video 
image including video of a different computer user; 

(b) combining, at a single computer, the n video images with a computer 
desktop image; 

(c) providing the combined image for display to each of the different users; 

(d) displaying the combined image , wherein displaying the combined image 
includes displaying images of the different users on or behind the 
desktop image and allowing the images of the different users to interact 
with desktop contents ; 

(e) tracking a portion of at least one of the n video images in the combined 
image; and 

(f) manipulating objects in the desktop image based on the tracked 
portion. 

36. (Previously Presented) The computer readable medium of claim 35 wherein 
manipulating objects includes highlighting the objects. 

37. (Previously Presented) The computer readable medium of claim 35 wherein 
manipulating objects includes moving the objects. 



Serial No. 10/562,240 

38. (Previously Presented) The computer readable medium of claim 35 wherein 
manipulating objects includes activating programs associated with the objects. 

39. (Previously Presented) A computer system comprising: 

(a) a display device; 

(b) n video cameras for producing n video streams, n being an integer of at 
least two, each video stream including video of a different user; and 

(c) a processing unit operatively coupled to the display device and the n 
video cameras, wherein the processing unit is adapted to: 

(i) receive the n video streams, combine the n video streams into a 
composite video stream including the video of the different users 
and provide the composite video stream for display to the 
different users , wherein displaying the composite video stream 
includes displaying images of the different users on or behind a 
desktop interface and allowing the images of the different users 
to interact with desktop contents ; 

(ii) determine a location of a predetermined object associated with a 
user in at least one of the plurality of video frames; and 

(iii) control execution of a program based on the location of the 
object. 

40. (Previously Presented) The system of claim 39 wherein the n video cameras 
are each positioned to produce a video stream including an image of a 
different user. 
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41. (Previously Presented) The system of claim 40 wherein the different users 
comprise collaborators in a distributed computer programming task. 

42. (Previously Presented) The method of claim 1 wherein the program comprises 
a collaborative desktop application. 

43. (Previously Presented) The method of claim 42 wherein the collaborative 
desktop application allows each user to control his or her own mouse pointer 
on a shared desktop. 

44. (Previously Presented) The method of claim 1 wherein at least some of the 
users are in different locations and wherein the program comprises a 
distributed computer programming application. 

45. (Previously Presented) The method of claim 29 wherein the different users 
comprise collaborators in distributed computer programming task. 

46. (Previously Presented) The computer-readable medium of claim 31 wherein 
each of the n video streams comprises an image of a different user. 

47. (Previously Presented) The computer-readable medium of claim 46 wherein at 
least some of the users are in different locations. 

48. (Previously Presented) The computer-readable medium of claim 47 wherein 
the different users comprise collaborators in a distributed computer 
programming task. 

49. (Previously Presented) The computer readable medium of claim 35 wherein 
each video image includes an image of a different user. 



Serial No. 10/562,240 

50. (Previously Presented) The computer readable medium of claim 49 wherein 
the different users comprise collaborators in a distributed computer 
programming task. 
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